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ABSTRACT 

The robustness of LISREL computer program maximtim 
likelihood estimates under specific conditions of model 
misspecif ication and sample size was examined. The population model 
used in this study contains one exogenous variable; three endogenous 
variables; and eight indicator variables, two for each latent 
variable. Conditions of model misspecif ication included errors of 
omission of structural paths and simultaneous errors of omission and 
inclusion. All misspecif icaticns were examined with sample sizes of 
100 or 200. In general, the effects of omitting a path from one 
exogenous variable to another were, less serious than were those of 
omitting a path from one endogenous variable to another. Adding a 
path from one endogenous variable to another endogenous varialr'^.e 
affected the estimation of parameters and standard errors less than 
any other misspecif ication . Overall, however, few blanket 
recommendations as to classes of errors most specifically affecting 
robustness of parameter estimates could be made. This study confirms 
that LISREL-type modeling should be undertaken only when there is 
guiding substantive theory. (SLD) 
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THE effect:; uF I>I0£)EL KIS;3ltCIKK'AllOH MID SMMLL 
ON LISREL MAXIMJH LIKELIHOOD ESTIMATES 

Statement of tne Problem 
Covanance structure mcaeiing using tne LlSREL program requires tne 
researcner to make certain fundamental assumptions aDout tne nature of 
tne available data, tne representativeness of tne sample, and tne 
Plausibility Of tne tneoretical model being tested. Tne statistical 
processes of specification, estimation, and testing of nypotnetical 
models presuppose important statistical and tneoretical conditions, and 
violations of tnese assumptions may seriously jeopardize tne consistency 
Of results. Sucn consistency, as it relates to tne reliability of 
parameter estimates and test statistics, may also be tenned robustness . 

The robustness of LISREL to violations of assunptions snould be 
known so that applied rese^cntrs can make more appropriate uie of this 
sophisticated data analysis tool. The appropriateness of the LISREL 
model and the accuracy of results when Known violations occur are 
subject to question. Most problems regarding robustness nave largely 
been ignored by applied researchers, though not by choice. Because 
LISREL is a relatively new statistical technique, statistical 
researchers have not yet been able to answer most questions regarding 
the robustness of LISREL. Some recent Monte Carlo studies nave examined 
the effects of using discrete variables or variables with skewed 
distributions; others nave attempted to systematically review the 
effects Of jample size anc model misspecif icatlon. However, much work 
remains before statisticians or applied researchers can feel reasonably 
sure that liSRl- results are robust to assumption violations or that 
violations will consistently distort results in Known and predictable 
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ways. 

rse purpose ;-j imr study is to exsmlne tne potmstness of USSEL 
auxiJUB lueiihosi estimates under specuic conditions of nodel 
■isspecif ication and saopie sue. The conditions of model 
misspecification include errors of omission of structural patns. errors 
Of inclusion of structural paths, and simultaneous errors of omission 
and inclusion of structural paths. All misspecif icatlons are examined 
under sample sues of lOO and zoo. By examlnin, the values of parameter 
estimates and comparing them to the population values, we have more 
specific inrormation about how such factors affect parameter estimates 
in applied research situations. Behavorial scientists need this 
information in order to make more informed decisions about model 
specification and us relation to substantive theory. 

Kesearcn Questions 
The results of previous simulation studies and the substantive 
Kno^ledie available on the nature of model specification lead to several 
questions: 

(I) Are certain types of specification error more serious in 
terms of parameter bias and/or model fit? This question has 
never been addressed adequately, althr^ugh GalUnl (i983) 
presented some preliminary observations and conclusions in 
the study Of coonon specification errors in path analysis. 
(2» Are compound specification errors more liKely to lead to 
parameter bias than are single errors of omission or 
inclusion? MacCaiium (19B6) has attempted to gauge the 
eflects Of compound errors. This question, however, needs to 
be answered more systematically by developing a typology of 
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possiDle error* otid toting tne elfects of such ei rors un tne 
sane structural model. 

(3) Are sample sixes of lOO more Ukeiy to lead to 
parameter dus than are samples of 200? Boomsma (t903) 
considered tne effects of sample size. MUcn of tnis work, 
however, dealt witn the roDustness of factor loadings. The 
same question in regard to the roDustness of structural 
parameter estimates needs to De answered. 

(4) Are sample sizes of too more likely to lead to 
proDlems with Heywood cases or nonconvergence of solutions 
than are samples of aoo? This issue was auo examined in the 
Boomsma (1983) study. The present study examines this 
proDiemnore thoroughly for structural equation models. 

(5) When the measurement model is not mlsspeclf led, win 
factor loadings De consistent from model to model? This 
question has not been specifically addressed in any previous 
study. 



The concept of the True Model 
This study attemptea to answer two questions: (i) how does sample 
size affe'-t the maxlmun likelihood parameter estimates produced by a 
LISREL-type model; and (2) how do specific instances of structural model 
mlsspecification affect the parameter estimates. Robustness studies of 
this type are coononly made using s Monte Carlo method. The main 
advantage of this empirical method is that the true distribution is 
known, not assuned, as in most analytical methods of study (Hatch & 
Postcn. 1966). The researcher Knows the true probability distribution a 
iriorl because the researcher is free to specify the distribution and 
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take samples from it (Acito & Aijderson, i984) TUus Monte Carlo memods 
involve tne generation and anal/sis of artificial data. 

TJie probability distriDution from wnicn to take smpits is 
devenained by tne problem at hand, in tnis case, lisrel structural 
equation model ir.s .^quires a bu it ivar late normal distribution. As it 
was not the ain of tnis study to examine tne effects of non-normal ity or 
tne effects of usini categorical data, tne indicator variajies were 
assumed to follow a our.ivariate normal distrirution. 

Uider typical applications of the LISREL model, a raw data matrix of 
size N X k would be obtained and a sample covariance or correlation 
matrix would be derived and used as input to the LISREL progr». in the 
Monte Carlo study, the generation of raw data is unnecessary, once the 
true model has been specified, true parameter values are determined. 
These parameter values are supplied to a computer progrm^ and the 
population covariance matrix Z is generated. 

If we regard the finite population matrix £ as a s^ple 
covariance matrix and analyze it using maximm likelihood estimation, 
the estimated parameter values would be exactly equal to the true 
P*-ameter values, in fact, regardless of the estimation procedure used, 
the obtained solution would be identical to the true solution, and all 
solutions would have a perfect fit to the data with a chi-square of zero 
(Joreskog a Sorbom, 1904). 

Sampling theory tells us that a sample t^i^en from a population 
(known or unknown) can yield an estimate that is either close to the 
population value or widely discrepant from it due ^o s«Bpllng 
variability, m Monte Carlo studies, the population values are known, 
and subsequent sampling produces estimates within the wide range implied 
by the population. Thus a specific sample may yield covariances that 
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are close to or wide;/ deviant from population covarjaiices, but on tne 
averace over nunerous samples, tne average s«iple values snould 
approxmate true population values (Hjonerle/ & Handscomb, 19W). 

The notion of sampling Drmgs up two otner questions: (i) wnat is 
the optimal sample size H; and (2) how aanv s^ples or number of 
replications NR should be generated. Sampie size affects the generation 
of sample estimates as it is known from sampling theory that larger 
samples have a higher probability of yielding sanpie values which are 
Close to the population vali:es. Also the nuD^er of replications >,^s an 
effect on this probability. Any one replication regardless of sample 
size may have sample specific characteristics. Thus multiple 
replications are necessary in Monte Carlo research. 

The optimal sample jize question is answered by consideration of 
past research. The LISKL likelihood ratio test assunes a large sample 
size and yet a definition of "large" was not examined until tne work of 
Boofflsma (I9e2a, I9a2b, 1963). Boomsma initially irxperimented with models 
using sample sizes of 25, 50, 100, 200, MO, and W)0. Analysis of his 
first model revealed that serious convergence problems often resulted 
from us)ng sample sizes smaller than 100. For s^ples of size N: 100, 
convergence problems and improper solutions were fewer, but the 
distributions of sample parameter estimates were not normal. In 
subsequent analyses, the samples using N:0OO were also dropped as 
estimates and chl-square statistics were not improved by the use of this 
sample size. The sample size N: 200 is a reference point established by 
Boomsma and considered in most Honte Carlo studies thereafter 
(Ethington, 1965; Gal 1 inl A HandevU le, 1903; Gerblng & ;»jiderson, 1905; 
MacCaiium, 1905). 

The nuDber of replications is also a primary issue that v»s first 




;xaained Dy 3doins»? (i963). Tnc nunoer of repiicnionj is a deteminin« 
i*2Ctcr in ^aiaoiisninf tr^ accuracy of s£spie parameters, scandard 
errcrs, and cm*square statistics, as ''nn sample sue, more usually 
means better :n terms of estimating population values. Monte Carlo 
studies fvmever are often limited by tne realities of using extensive 
camDuter time, the cost of sucn time, and tne sheer difficulties of 
n^d*Anc the massive affounts of nunbers produced by a Monte Carlo study. 
For instance, Boomsma (1963, p. 46) states that use of a 99z confidence 
level would require 6643 replications, if a mode: were estimated that 
contained 20 parameters, producing the estimates, the standard errors. 
the t'values, the modification indices, the variances of the estimates, 
and the chi-square statistics would require handling lOi pieces of 
information for each replication or 670.943 nunbers for all 6643 
replications of one model. The amount of information is even more 
staggering when one considers that most studies involve comparisons of 
many modeis. 

Boomsma first used lOO replications for his initial work. After 
studying the results, the nunb^sr of replications was increased to 300. 
The demands of computer time, storage of information, and amount of 
information were heavy but not unreasonable. The results were greatly 
improved by using 300 replications instead of 100 as the standard errors 
were reduced by half. Therefore for this study 300 replications were 
used for each model tested. 

Model Jescription 
The population ax>dei used for this study was designed so as to 
represent a nuDber of structural specifications coononiy found in 
applications. Such specifications could then be manipulated in the 
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models to De tested, and the effects on tne models examined. Tne true 
Bodel is presented m Figure and tne population parameters are given 
in Table l. 

The population ziodei contains one exogenous variable, three 
endogenous variables, and eight indicator variables, two for rach iatent 
variable. Although the use of three indicator variables per latent 
variable would reduce the parameter bias that sometiffles occurs when two 
or fewer indicator variables are used, it is useful to study the 
behavior of parameter estimates under the worst possible conditions. 
Also, the use of two indicator variables per latent variable is not 
uncoinnon in applied research (Gerbing & Anderson. 1985; Boom5ma, 1986). 
For the present study, all model misspecif ication occurs in tne 
structural model; the measurement model remains constant and consists of 
indicators generated from a multivariate normal distribution. 

The following nine possible types of structural model 
misspecif icat ion were studied: 

1. Errors of omission 

A. Gttitted path f ron an exogenous variable to an 
endogenous variable (which no;/ becomes an 
exogenous variable), 

B. emitted recursive path from an endogenous 
variable to an endogenous variable, and 

C. ciDitted non-recursive path between endogenous 
variables. 

2. Errors of inclusion 

A. Included path from an exogenous variable to an 
endogenous variable, 

B. Included recursive path from an endogenous 



9 



8 



varlaDle to an endogenous varlaDle. and 



c. Included non-reoursive patn Detween endogenous 



variables. 



3, Simultaneous errors of omission and inclusion 

a. CfeBitted patn from an exogenous variable to an 
endogenous variable <wmcn now becomes an 
exogenous variable) and included patn from an 
exogenous variable to anotner endogenous 
variable, 

o, c-Ditted recursive pain from an endogenous 

variable to an endogenous variable and included 
recursive path fron an endogenous variable to 
anotner endogenous varla^^le. and 

c. Oaltted non-recursive patn between endogenous 
variables and included a different non-recursive 
patn between endogenous variables. 

Generation of Sample covarlance Matrices 
a nd Estimation of tne Hisspecified Models 

Using tne assltned true parameter values, tne model was specified 
and tne population covarlance matrix generated using a SAS PROC MATRIX 
program. Tne population covarlance matrix S is used to generate 300 
sample covarlance matrices S for each model to be tested. The sample 
covarlance matrices were produced by using a FORTRAN Wlsnart variate 
generator program (Smith & Hocking, 1972). This FORTRAN routine 
generates a sample covarlance matrix from a multivariate normal 
population with mean vector p and the specif ked sample sl7e. 

USREL programs were written for each of the nine models to be 
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tested, in addition, eacn model was tested under iwo sample 5i2es, n-. 
100 and N=200. Tnus lO comDlnatlons of model mlsspi-rif icatlon and 
sample size were tested for a minimum total of 5400 replications over 
tne entire study. Tne LISREL program computes starting values using an 
instrumental variables metnod (non-recursive models) or a least squares 
metnod (recursive models), use of tnese starting values effectively 
cuts down on the computer time required for estimation and aids in 
reacning a convergent solution witnin tne 250 iteration limit imposed by 
tne LISREL program. 

The relevant output from tne program runs consisted of tne maxlmun 
Ukelinood parameter estimates, tJie standard errors of tne estimates, 
modification i.idlcer; ior all parameters tnat were not being estiu»ated, 
and *ne cni-square goodness-of-f it value wltn the associated decrees of 
freedom. Means and average standard errors of parameter estimates were 
computed across replications for eacn combination of model and sample 
size N. 

Assessment of tne results was based on tne following criteria: 
(1) Average parameter estimates for eacn model and sample 
size combination across replications 

A. Bias of sample estimates: Is tne average sample 
parameter estimate different from tne actual 
parameter value? This relative difference was 
judged hy computing a difference statistic 

it^ wnicn is [(w - wv w) X 100. 

B. standard errors of s^ple estimates: Is tne 
root mean square error (RMSE) of a parameter 
estimate different from tne expected standard 
error? rne RMSE is an unbiased estimate of tne 
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average standard error for a restricted sample 
cms statistic IS tne square root of tne 
'iraje Lncorrected sia ot squarts for a 
:ir'*"^?jijeter estiaute. The actual standard errors 
ouid provide a Diased estimate if averaged, 
rne expected standard error is tne standard 
i.^^or wnen Z is used fo.^ a specified sample 
'>ii:e. mis relative difference was judged by 
computing a difference statistic se^j wnicn is 
C(RMSE - St)/ se] X iOO. 
(?) Average chi-squ^*.. c across replications: Wouid a 

fflisspecif ied fflodei still De considered a good fit? What 
is tne rate of rejection for misspecif ied uodels? 

(3) Modification indices for errors of omission 

A. Averag'^ modification index for a particular 
error. 

B. Percentage of cases in wnicn tne index is 
mgnest for tne misspecif ication mads: Does the 
modification index correctly indicate the model 
adjustment to De made? 

(4) T-va'ues for errors of inclusion 

A. Average t-value for error: is tne t-value 
significant? 

B, Percentage of cases in wnicn tne t-value is 
insignificant: Does tne t-value correctly 
indicate tnat tne parameter should De set 
equal to zero? 
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Improper solutions and Nonconvergence 



In addition to analyzing information aDout model mlsspecif icatlon, 
parameter bias, and resultant soodness-of -f it, it is also of interest to 
consider tne occurrences of improper solutions and nonconvergence in a 
Monte carlo study, improper solutions result wnen maximum liKelino-jd 
estimates of variances are nega • mese negative variances indicate 
tnat tne solution is unstable. Honconvergence was defined as tne 
InaDUlty of tne program to find a unique solution wnicn meets tne 
convergence criteria witnin 250 iterations. Often it is uncertain 
wnetner raising tne maximum nunber of iter ions will lead to a final 
solution. In cases of MOnte carlo study, it Is often more efficient to 
simply terminate tne program after 250 iterations (Boomsma, I982a, 
1985). Sucn was tne case in tne present study. 

Negative estimates of variances or Heywood cases are problematic in 
tnat tne solution is suspect, in Monte Carlo researcn nowever, tne 
sol^utions are often regarded as plausibU and tne parameter estimates, 
standard errors, and cm-square statistics are analyzed as for 
admissible solutions (Br^omsma, I9d2, 1985; Rlndskopf, 1984). Gerbing & 
Anderson (1985) disagree, and nave empnasi:ed tnat inclusion of improper 
solutions may lead to problf"^^ oi interpretation and additional bias. 

For tnis study, improper solutions were included in tne analysis 
unless tne improper solution.^ represented a sizeable percentage (over 
lOx, of tne replications for any one model, it was planned tnat if some 
particular models nad overly nimerous improper solutions, tne bias of 
parameter estimates would be calculated twice— once witn tne improper 
solutions Included and once wltn tne Improper solutions excluded. In 
tnis way, tne influence of improper solutions on Monte carlo results 
could be examined more tnorougniy. rnese measures were not needed. 
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nowevsr, as nort cf ^ne mlsspeclf led models produced more tnan 10^ of 
;;iiproper solutions. 

A more .:erici.5 proolem in Home Carlo researcn is mat of 
nonconvergence. In general, nonconvergence problems are most often 
cjfccl^ted run smzll sample sizes. Because tnis stud/ involved sample 
sizes of 100 and 200. it was expect d tnat nonconvergence problems would 
be infrequent, since tne solution in a nonconvergent LISfiEL analysis 
ma/ deviate widely from true solution, nonconvergent solutions were 
not included in tne analysis. Any solutions tnat were nonconvergent 
were discarded and anotner computer ar^alysls witn a new random sample 
was used to take its place, in otner words, tnere were at least 300 
converged replications for eacn model tested. 



Eacn case of model mlsspeclf icat ion was studied for eacn of two 
sample .^izes, NUOO and N:200. rnus 16 cc iblnatlons of model 
mlsspeclf ication and sample size were tested witn at least 300 
replications per combination. Tne program output was compiled and tne 
PROC UNIVARIATE procedure of SAS was used to tabulate average parameter 
estimates, root mean square errors, average modification indices, and 
tne frequencies of estimates across replications and wltnin eacn 
combination. T-values were determined, and tne relative difference 
statistics u)^ and se^ were calculated, rnese data provide 
Information about tne effects of model mlsspeclf icat ion, parameter 
estimate bias, and tne resultant goodness-of ~f it of tne mo*^el. In 
addition, tne frequency of improper solutions and nonconvergence were 
examined. 
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Sumaary of tne Re5ults 



In ordc * to cofflpars tne rates of nonconvergence and improper 
solutions across models and sample sizes, TaDle 2 presents an overview 
of tnese results. In general, tne incidence of nonconvergence and 
Heywood cases was tne same for Dotn samoie sizes. However, for Models 
lA, 2B, and 3B tne difference In tne rates of nonconvergence was 
larger. For Model lA, a sample size of 200 produced I'f- nonconvergent 
solutions as opposed to 13/. for N:loo. For Models 2B and 38, tne rates 
were 4X for Ns200 and 13/. for Nnoo. Models IB, 2C, and 3a nad tne 
nignest rates of nonconvergence- 49^, 37/., and about 50/. respectively. 
Tfiere were no models in wnicn tne rates for improper solutions was 
nigner tnan 10/.. 

Tables 3. 4, and 5 present suanmaries of tne results for Models 1, 2, 
and 3. These tables give qualitative information on tne relative 
performance of tne models for eacn of tne sample sizes considered. 
Tnese tables are based on similar tables found in Boomsma (1963). Part 
I of eacn table indicates tne degree of bias for tne parameter estimates 
and standard trrort. Part 21 indicates tne aegree of departure from 
optimal performance. For example, if a misspecif led model nad a nign 
rate of acceptance and an average value less tnan tne critical 
value, sucn performance could not be considered optimal as tne 
gvodness-of-f It is misleading. 



Tne purpose of tnis study was to examine tne robustness of LISREL 
maximum UXelinood parameter estimates under specific conditions of 
model misspeclf icatlon and sample s^ze. Tnese conditions of model 
mlsspecif icat ion are trror% of omission of structural patns. of 



Discussion of tne Results 
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inclusion of structural paths, and sinrjltaneous errors of omission and 
inclusion of structural pavns. By examining tne values of tne parameter 
estimates and comparing tnem to tne populatlort values, we nave some 
specific Information aDout now such factors may affect parameter 
eszitaates in appileJ research situations. In addition, tnis study nas 
investigated th* ^^fects of model mlssoeciiicatiu ;^nJ sample size on 
the estimates or staiidard errors, tn* .^-values, tne modification 
indices, tne aoodness-of-f it of tne model, and tne frequency of 
nonconvergent and improper solutions. These results wi|i similarly 
provide us with information that may aid researchers In making informed 
decisions with regard to the theoretical specification of LISREL models. 

Certain types of specification errors seem to De more serious in 
terms of parameter Dlas and/or model fit In general, the effects of 
omitting a path from an exogenous variaDle to an endogenous varlaDle 
seem to De Iffss serious than the effects of omitting a path from zn 
endogenous varJaDle to another endogenous varlaDle. The estimation of 
parameters and standard errors was affected much less Dy the former 
error than Dy the letter. The marK<*d Dlas of the structural parameter 
estimates when a path from one endogenous variaDle to another endogenous 
variaDle is omitted should De noted. Non convergence proDlems were also 
more frequent when such a path was omitted. The measures for 
goodness-of-f It appropriately indicated a lack of congruence Detween the 
data and the theoretical model except in the case of Model IB with 
K=100 

Adding a path from one endogenous varlanle to another endogenous 
varlaDle affects the estimation of parameters and standard errors less 
than for any other misspeclf cstion. regardless of sample size. 
However, the misspecified model wou.'d De accepted as a good fit with a 
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snco^enoui variatle preiented nunerous nonconver«ence proDiems. one 
./ouid ex?2Ct tnac tne modei containing simultaneous errors mi«nt 
ii;:- ;se affected, but tnis »yas not tne case. Tne particular 
voDiems for tnis alsspecif icatlon may De model-specific, tnat is, due 
to tne repartitioning of direct and indirect effects in contrast to sucn 
effects in tne true model, of tne four latent varlaDles in tne model, 
three are endogenous, mere is a certain dynanlc to tne flow of direct 
and indirect effects in tnis model. For tne case in wtiicn reciprocal 
paths are present, an almost circular flow of effects could De assuaed. 
emitting a '*aajor- patn in tne model may restrict tnis dynamic flow. 
Thus tne nonconvergence problems may be more indicative of 
model -specific tendencies than due to the deletion of a particular type 
cf path. 

Sample size seemed to be a minor issue in many of the models studied 
If tne models are examined on a case-by-case basis. There seems to be a 
general "rule of thunb- in that those models which fit well and are 
relatively -easy* to estimate can be estimated well whether the sample 
size IS 100 or 200. On the other hand, models which have convergence 
problems or which do not fit well will usually have similar results for 
the different sample sizes as well. This does not mean, however, that a 
sample size of lOO n^^cessarily gives the same results as a sample size 
Of 200. In particular, the standard trrors seem to be greatly affected 
by sample size. This was particularly true for Models ia and ic. Sample 
estimates of standard errors were much closer to population values when 
N:200. Even when the parameter estimates themselves were relatively 
unbiased for N:l00, comparisons to the results of N5200 snw that these 
estimates are even more accurate for the larger sample size. The 
incidence of rejecting a mlsspeclf led model also seems to improve when 

18 
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tne sample size is increased. T-vaiue$ more adequate:/ reflect tne 
inclusion of extraneous patns. and tne aiodlf ication indices more 
accurately flag tnose paths wtilcn snould De included in tne model. 

Overall, few DlanKet recoinnendations as to tne classes of 
specification errors wnicn most seriously affect tne roDustnesr of 
parameter estimates can De made. From a theoretical point of view, it 
mimt seem that adding a path to an otherwise correctly specified model 
would De the least innocuous of all errors, inspection of the parameter 
estlioates for the model s tested would seem to support this notion. 
However, it must be pointed out that the goodness-of-x it for all errors 
of inclusion was very good, a Dlt of information that is quite 
misleading, in addition the standard errors for all of these models 
were moderately to strongly Dlased. such Dias can also affect 
conclusions as to the Significance or non-sign if icance of individual 
parameters. 

wti^ch errors are of the most consequence from an applied standpoint? 
Exclusion of p paths, inclusion of reciprocal paths m models that 
already contain a reciprocal path, an^ multiple errors of any sort seem 
to have the most serious consequences for causal modeling. Such errors 
Dias structural parameter estimates and severely distort standard 
errors. Recovery from such misspecif ications is douDtful. T-values win 
not De reliable, modification indices cannot De guaranteed, and model 
goodness-of*f It is also affected. 

The results of tins study support some conclusions from past 
research. The recomnendation Dy Boomsma n983) to use sample sizes 
larger than loO is supported. Although the average statistics 
did not indicate any overall improvement from N:ioo to H=200, the range 
of values is much smaller for Nt200; thus, the proDaDility of 
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oDciming a reiiaole test statistic is men improved for tne larger 
saooie sue. c^cussec previously, sample sixe nas a definite effect 
on tne estimatlcr of paramecers. standa.^ errors, and modification 
indices. 

MacCalliai'5 i*r8S) research sno*ec tnat models witn one 
•aisspecif ic£tlor. error often were not rejected, mis researcn 
cleoun:;trate$ tnat models containing errors of inclusion are particularly 
at nign risK of ioelng erroneously accepted as plausible. On tne otner 
hand, models containing errors of omission may »e rejected or may fail 
to be rejected depending upon the type of patn omitted, contrary to 
Maccallum's study, two misspecif ication errors do not necessarily 
increase the chances of rejecting a model . The types of errors made 
seem to be more Important than the number of errors. For instance, for 
Model 3C Which omitted and included reciprocal paths, the model was 
accepted as plausible inmost replications. This was true despite the 
fact that structural parameters were biased. 

Gerbing & Anderson's (1905) Home Carlo study demonstrated that the 
variability of parameter estimates decreases as saii^ple size Increases. 
This finding was likewise supported in this study. Their findings are 
based on research Investigating the effects of model characteristics on 
parameter estimates In conf imatory factor analysis. However, it makes 
intuitive sense that parameter estimates should likewise be affected in 
structural equation models. 

Gerbing & Anderson also noted that sample size and the nunber of 
indicators per latent variable had large effects on the structural 
parameter t which relates two factors. This study found a somewhat 
similar effect on the variance terms of the matrix ♦ and on the 
disturbance terms of the matrix V. By misspecif ying the model and by 
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liiDltlnf the number of indicatori to two. estimation is nindered. The 
incidence of oias for the parameters in these two matrices was much 
nifher, even in cases in which the bias of other parameters was limited, 
and the model otherwise perfonned optimally. This was particularly true 
for sample sues of lOO. The bias of these parameters indicates that 
the mlsspecif icatlon introduces a degree of uncertainty into the 
estimation procedure. *tjch of the variance which is otherwise accounted 
for in the population model cannot be explained in the misspecif led 
model. Thus these terms are apt to oe affected. 



The develofuent of LlSREL-type structural equation models has 
decidedly influenced the direction of educational research in the pa t 
few yeaps. Causal modeling techniques allrw rese^rcners to hypothesize 
about vhe complex relationships among theoretical variables in a maimer 
that IS not possible with path analysis or multiple regression. 

The popular usage of any statistical technique leads many 
researchers to speculate on the utility of that technique, while the 
robustness of more traditional methodologies against violations of 
assumptions has been tested, the effects of such violations are not 
clear when using LlSR£L*type models. These procedures have only 
recently been under study. 

This study adds to the literature by having examined the effects of 
model misspecif icatlon and sample size. Although the generalizations 
of the study are restricted due to the particular class of models anc- 
the particular types of misspecif ication ex^lned. such (generalizations 
may lead us to a more "informed guessing" of how such model 
misspecif icat ions may affect results when working in an applications 
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context, Althougn linear structural equation modeling is never 
recooaended tu !>c used in tfte total absence of substantive tneory. tne 
prasence oi equally plausible yet conflicting theories ma/ result in 
various different opdei specifications for tne sane theoretical researcn 
question, jcnovled^e of tioir ocdeis oeliave under alternate 
mlsspeclf icatlons is a valuable asset in sucn situations. 

in general, the results of tnis study strongly confirm tne idea that 
USREL-type modeling must be undertaken only when there is guiding 
substantive theory, m many cases, mlsspeclf led models were 
inaccurately described as having acceptable goodness-of-f it. 
Alternative models may have equally good fits. The ultimate decision to 
accept a model oust lay with the researcher. The nmbers themselves 
cannot be used as the sole criteria for judging the quality of a model. 
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PARAH£T2n 



*y32 * 

*y53 
*y63 
*Kll 

*K2l 

^13 
^3t 
032 
V|| 
V2I 
♦II 
^11 
^22 
▼3 3 
•cll 
•€22 
•c33 

•c55 
•cb'i 
•ail 

•a?.2 



■ factor loadings of 1.0 art fixed for aanifest variable! 



TADLE I. VALUES OP POPULATION PARAMETERS 



Model iA 



Model iB 



Hs cDO 100 200 100 

Part I. ^ 

31a» o< factor - . 

loadinis 

Bias of structural - - 

.'5ar?jcetcr5 

0. PM - . i. i. 

cr PS J matrices 



dtas Oi ueas. 
error terms 



3tas of standard 
errors 



?art II. » 

Goodress-of-f It 

nodtf teat ton tndex 
for error 



T-value for err - NA NA NA Na 

Honconverience ■ ■ 

Improper solutions ■ ■ . . 



*Part I indicates the degree of bias from stroniesr ) to no 
bias (-). The degree of bias was based on the nunder o: 
parameters affected and tne severity of the bias. 

*>Part II indicates decree of departure from optimal performance 
It ranges from strongest departure (■• ) to no departure (-). 



TABUB 2. aNtUAT OF RESULTS TOR nxXL 1 



Model 2A tio69l ar Model 2C 

H» 200 JOO 200 100 200 100 



Blaf of factor 
load inf s 

tfias of structural 
paraneters 

Bias of pni 

or psi aatrlces 

Bias of aeas. 
error terms 

Bias of standard 
errors 



Part II « » 
Goodness -of -f 1 1 



■ ■ R R 



Hodlficatin index MA MA MA MA MA MA 

for error 

T'value for error - - . , 

Nonconverg encc r ■ - « rr rr 

iBproper solutions - - - 



*Part I indicates degree of Dlas from strongest to no bias 

(-). The degree of bias was based on the number of parameters 
affected and the severity of the bias. 

^Part II indicates degree of departure from optimal performance; 
It ranges from strongest departure (•■) to no departure (-) 



TABLE 3. SUMMARY OP RESULTS FOR MODEL 2 
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Part I, a 

Bias cx factor 
load intt 

91e* ci structural 
Oiiresisters 

3iai; ox pnl 

or oji netrices 

lias oi* tieaL. 
error terms 

31AS of Jt^ndard 

error*. 



3A Model 3B Model 3C 

"° 200 100 200 100 



G00C"(!»3 -of-f 1 1 

ModltlcaLion index 
for error 

T'valut for error 

Nonconverience 

Improper solutions 



■ IN 



Part 1 indicates the decree of bias from jtronieit («■ ) to no 
bias (-). The deiree of bias was based on the number of 
parameters affected and the severity of the bias. 

**P4rt 11 indicates deiree of departure from optimal performance; 
It ranges from strongest departure {»• ) to no departure (-). 



TABLE StJM^URY OF RESULTS FOR MODEL 3 



ERLC 



28 



Toial 
Solutions 



Honconvergence 



Improper 
Solui iuiis 



Model lA 
Hz ZOO 
N:lOO 

Model ID 

Nr200 
mi 00 

Model IC 

N:200 
N:100 

Model 2A 

N:200 
NMOC 

Model 2B 
N:200 
N:100 

Model 2C 
N:200 
NMOO 

Model 3A 

N:200 
N:lOO 

Model 3B 
N:200 
N:100 

Model 3C 
N:200 
N:100 



327 
35C 



597 
600 



350 
350 



339 
350 



343 
350 



400 
4^7 



636 
642 



351 
372 



322 
351 



£2(7/ ) 
44(13/ ) 



.91 (49/ ) 
"91 (49/ ) 



0(0/) 
COX ) 



27(8/ ) 
26(7X) 



14(4/ ) 
'H(13/ ) 



176(37/ ) 
ie7(37y ) 



324(51^^ ) 
322(50/ ) 



13(4/) 
50(13/. ) 



0(0' ) 
0(0M 



26(9/ ) 
29(9/ ) 



7(3/ ) 
9(3') 



17(5/ ) 
21(6% ) 



10(3/ ) 
17(5/) 



6(2/ ) 
5(2n 



0(0/ ) 
0(0n 



2(1M 
l(OZ) 



6(2M 
25(8/ ) 



1 (0/ ) 
16(5/ ) 



TABLE 5. ilVHOPBR 50U;nor«5 AWD rWVN^UfCBVE 
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